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Abstract 

We prove an Erdos-Feller-Kolmogorov-Petrowsky law of the iterated logarithm for self-normalized 
martingales. Our proof is given in the framework of the game-theoretic probability of Shafer and 
Vovk. As many other game-theoretic proofs, our proof is self-contained and explicit. 
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1 Main Result 

Let Sn be a martingale with respeet to a filtration {!F„}“^o let x„ = Sn - Sn-i be the martingale 
differenee. On some regularity eonditions on the growth of \Xn\, various versions of the law of the iterated 
logarithm (LIL) have been given in literature. In partieular the Erdos-Feller-Kolmogorov-Petrowsky 
law of the iterated logarithm (EFKP-LIL ifT^ Chapter 5.2]) is an important extension of FIE. Erdos (bll 
proved EFKP-EIE for symmetrie Bernoulli random variables. EFKP-EIE has been generalized by Feller 
[171 for bounded and independent random variables and B (see also Bai (HI) for the i.i.d. ease. Further, 
EFKP-FIF has been generalized for martingales by Strassen [[T91 . Jain, Jogdeo and Stout IfTOl . Philipp 
and Stout [|T5l . Einmahl and Mason [|5l and Berkes, Hermann and Weber [[21. In partieular, Einmahl and 
Mason [j5l proved a martingale analogue of Feller’s result in [|71, just as Stout IfT^ obtained a martingale 
analogue of Kolmogorov’s result in ifTTl . 

For self-normalized proeesses, EFKP-FIF was derived by flUISl in the i.i.d. ease. However EFKP-FIF 
has not been derived in the martingale ease, even though de la Pena, Klass and Fai [jH obtained the usual 
FIF. The purpose of this paper is to prove EFKP-FIF for self-normalized martingales. For a positive 
non-deereasing eontinuous funetion let 

m := ( 1 ) 


We state our main theorem. 
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Theorem 1.1. Let Sn = 1,2,..., be a martingale with 5o = 0 and Xn = S„ - Sn-i be a martingale 
difference with respect to a filtration g 

\x„l < c„ a.s. 


for some ff„-\-measurable random variable c„. Let 


AI-=Y^x] >0 
1=1 


and let if be a positive non-decreasing continuous function. 
If I (if/) < oo, then 


2^3 


P 5„ < A„if/{Af) a.a. \ limA„ = oo,limsupc„ 




< 00 = 1 . 


If liff) = oo, then 


P 5'„ > A„if(Al) i.o. I limA„ = oo,limsupc„ 




< oo = 1. 


( 2 ) 


(3) 


This theorem is a self-normalization of the result in Einmahl and Mason [[51| and a generalization 
of the result in de la Pena, Klass and Lai flU. The order of growth A„/{if{Al)f for c„ is currently the 
best known order for EFKP-LIL even in the independent case ([[21). We call © the validity and @ the 
sharpness of EFKP-LIL. 

In @ and we are not assuming that the conditioning events happen with probability one. We can 
state @ equivalently as 


P limA„ = oo,limsupc, 


HAi) 


2x3 


<oo,Sn> A„ifiAf} i.o. = 0. 


(4) 


For our proof we adopt the framework of game-theoretic probability by Shafer and Vovk ffTTl . In a 
game-theoretic approach, for proving @, we explicitly construct a non-negative martingale diverging to 
infinity on the event of @. 

We use the following notation throughout the paper 


In^n := Inln^..In n. 

Mmes 

We also fix a small positive 6 for the rest of this paper, e.g., 6 = 0.01. For our proof, as is often seen in 
the upper-lower class theory (cf. Feller [[H Lemma 1]), we can restrict our attention to if such that 

if^{n) < if{n) < if^(n) for all sufficiently large n, (5) 


where _ _ 

if^(n) := sj2 ln 2 n -I- 3 Ina n, if^{n) := 

Here L means the lower class and U means the upper class. It can be verified that I{if^) < oo and 
Hif^) = oo. 

The rest of this paper is organized as follows. In Section [^ we give a game-theoretic statement 
corresponding to our main theorem. In Section [3] we give a proof of the validity and in Section [4| we give 
a proof of the sharpness. 
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2 Preliminaries on Game-Theoretic Probability 


In order to state a game-theoretie version of Theorem ll.li eonsider the following simplified predietably 
unbounded foreeasting game (SPUFG, Seetion 5.1 of ifTTl ) with the initial eapital or > 0. 

Simplified Predictably Unbounded Forecasting Game 
Players: Forecaster, Skeptic, Reality 

Protocol: 

TCo := a. 

FORn = 1,2,...: 

Forecaster announces c„ > 0. 

Skeptic announces 6 R. 

Reality announces Xn 6 [-c„,c„]. 

'Kf, .= "I" MfjXfi- 

Collateral Duties: Skeptic must keep *7C, non-negative. Reality must keep *7C, from tending 
to infinity. 

Usually a is taken to be 1, but in Section |4] we use a I for notational simplicity. 

We prove the following theorem, which implies Theorem 1 1.1 1 by Chapter 8 of [fTTl . 


Theorem 2.1. Consider SPUFG. Let if/ be a positive non-decreasing continuous function. If I (if/) < oo, 
Skeptic can force 


0 

^ oo and limsupc„-< oo 

A„ 


S„ < Anif/(Al) a.a. 


and ifl(if/) = oo, Skeptic can force 


2 

A„ ^ oo and limsupc„—--< oo 


Sn>Anlf/(Al) i.O. 


( 6 ) 


(7) 


We use the same line of arguments as in [IT4l and Chapter 5 of Shafer and Vovk lUTll . We employ 
a Bayesian mixture of constant-proportion betting strategies. Here we give basic properties of constant- 
proportion betting strategies. 

A constant-proportion betting strategy with betting proportion y > 0 sets 


Mn = yKn-l. 


However, TG becomes negative if yx„ < -1. For simplicity we consider applying the strategy (“keep the 
account open”) as long as ycn < 6 and sets Mn = 0 once yc„ > 6 happens (“freeze the account”). Define 
a stopping time 

CTy := mm{n \ yCn > d}. (8) 

Note the monotonicity of cr^, i.e., o-y > dy if y' < y. We denote the capital process of the constant- 
proportion betting strategy with this stopping time by ‘Kf. With the initial capital of TCq = a, the value 
of TCJ is written as 


min(n,(Ty-l) 

‘Kl = a P] (l+yxd. 

i=\ 
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By 

f- 

t - — - f x\t\< ln(l + t)<t - — 

for \t\ < 6, taking the logarithm of n”=i(l + for ^ we have 


2a2 


r A; 


.2a2 




ySn - - r^Alcn < ln(7CJ/Q') <rSn -+ y^Alcn 


and 

where 


-rAlc„ yS„-y^All2 


< noja < 


rAic„ yS„-y^Al/2 


( 9 ) 


Cn := maxc/. 
!</<« 


We also set up some notation for expressing the condition in ® and (|7]). An infinite sequence of 
Forecaster’s and Reality’s announces to = {ci,X\,C 2 , X 2 ,...) is called a path and the set of paths Q = {to} 
is called the sample space. Define a subset D<oo of D as 


D<cx, := \to\ aI ^ oo,limsupc„ 




2^3 


< oo 


For an arbitrary path to 6 D<cx, we have 


3C(m) < oo,3ri(u;), Vn > ni{to), c„ < C(a>) > 1- 


( 10 ) 


The last inequality holds by the lower bound in ([5]). 


3 Validity 

We prove the validity in ® of Theorem 12. II In this section we let cr = 1. We discretize the integral in ([T]) 
as 


(11) 

fe" ‘ 

Since is decreasing for x > 1, the function A is decreasing for A such that i//{A) > 1 

and convergences of the integral in ([T]) and the sum in (fTTl) are equivalent. 

The convergence of the infinite series in (fTTl) implies the existence of a non-decreasing sequence of 
positive reals aj, diverging to infinity (a^ 1 oo), such that the series multiplied term by term by is still 
convergent: 




Gk- 


ifrik) 


-my2 


< oo. 


A'=l 


This is easily seen by dividing the infinite series into blocks of sums less than or equal to 1/2^ and 
multiplying the k-th block by k (see also [fT3l Lemma 4.15]). 

For k > 1 let 



*A(^) -^(A)2/2 
k 
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and consider the eapital process of a eountable mixture of eonstant-proportion strategies 


A:=l 


"Kn := where yu '■= 


( 12 ) 


Note that TC is never negative. By the upper bound in Q, as k ^ oo we have 

I2\n2k + 4\n^k 


7 k < 


yfic 


0 . 


(13) 


We show that lim sup„ 7C = oo if a path oj e f2<oo satisfies S„> A„i/r(A^) i.o. We bound ZTC), as 


Z*7C„ > . 


(14) 


At this point we eheck that all aeeounts on the right-hand side of (fT4l) are open for sufficiently large n 
and the lower bound in (|9l) can be applied to eaeh term of (fT4l) for co 6 Q<oo. We have the following two 
lemmas. 


Lemma 3.1. Let co e Q<oo- Let C = C(co) in (fTOl) . For sufficiently large n 

c„ = maxc; < (1 -r 5)C—^. 
i<;<« 


(15) 


Proof. Note that the first n\{(jo) c’s i.e., Ci,... ,c„,(^), do not matter sinee lim„^oo A„/^(A„)-* = oo. For 
I > nfco), by (fTOl) we have 

Hence c/ sueh that A/ < A„l\J/{A^ff do not matter in c„. 

For Cl sueh that A/ > A„/i/r(A^)^ we have 


2\3 


Cl < C 


< C 


c- 


mi) 




Butby (l5]),bothi/f(A^) andi/r(A^/^(A^)®)areoftheorder A/2Tn7^(l+o(l)) and i/^(A^)/i/^(A^/(/f(A^)®) ^ 1 
as n ^ oo. Hence (fTSl) holds. □ 

Lemma 3.2. Let to 6 f2<oo. For sufficiently large n, cTy^. > nfor all k = [/if - A^/i/r(A^)J,..., \ Af\- 

Proof By the monotonicity of f, we have jk < ^(A^)/ ^jyAl -Al/if/{Al)\ for k = lAl-Al/i//{Al)\,..., [A^J . 
Then by the monotonicity of cr^, it suffices to show 


HAD 


I Cm ^ S 


for suffieiently large n. By (fT5l) . the left-hand side is bounded from above by 


HAD 


But this eonverges to 0 as n ^ oo. 


X (1 + 5)C 


An 


HAlf 


= (1 + 6)C- 


An 


VLA2-a2M(A2)j HAir 


□ 
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By Lemma [^21 and the lower bound in (jH), for sufficiently large n, we have 

k=VAl- Allil,{Al)\, ..., [All 

and Z*7C can be evaluated from below as 

,2 4 2 


LA,h 

Z7C„ > Z ^ pk exp(y^S 

k=[Al-Al/ifr{Al)i 

lAli 

ak 


rtK 


- rlAlCn) 


2_j —j— exp(-^ - —-r^A„cJ 


k=[Ai-Ai/^{Ai)\ 

Now we assume that 5„ > A„iff{Al) i.o. for the path oj g Q.<oo- Then for sufficiently large n such that 

1 /2 

Sn> iff(Al) I (if/{Al) - 1) < 1 + d and A^j {\_Al - < 1 + d, we evaluate the exponent 

part by (|9l) as 

Hkf , ^ rlAl ^(kfAl 

- +ykSn ->-+ Anil/{AJ—^ - 


Afk 


ik(k) 




> 


V 

HAlf 


k 2 


k 


mlf (A 


> 


1 

k 


and by Lemma ITT] 


' 1 / 'AO;) 

- 2WaI)-\ 


2\3 


ylAlcn < 


HAt) 


(LA2-A2/^(A2)jf2 
A 


> -- - 2d 
2 


Al(l+S)C 


^{Alf 


< (1 + d)C 


XVAl-Allilf{Al)\f'^} 

< C(1 +d)^ 

For sufficiently large n, we have 

iA(A^) < {2k) = V21n2 2k + A\n^ 2k < 2 = 2il/^{k) < 2il/{k). 

Thus by (fT^ . 


(16) 


LA„h 

Z7C„ > 

k=lA)i-Al/if){Al)\ 


a,t-^expl-- - 2d - C(1 + d) 


. ^jAl) 

- ‘^\_Al-Allik{Al)\ 2^2 


VAl\ 

E 

k=\.Al-All<lj(Al)\ 


exp|-- -2d-C(l +d) 
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> a\ 


I 


2A2 \,Jf(Al) 


1 exp -- -25-C(l +5) 


Since a 


yAl-All^(Al)\ 


= (^[_Al-All^(Al)\ ^2 “ 2A2 j 1“ 2 ~ ~ ^ ■ 

oo as R ^ oo, we have shown 

o) 6 Q<oo, >S'„ > A„if/(Al) i.o. => limsupTC, = oo- 


4 Sharpness 


We prove the sharpness in (|7]) of Theorem IXTl As in Section 4.2 of IfTTl and in lfT3l . in order to prove the 
sharpness, it suffices to show the following proposition. 

Proposition 4.1. Consider SPUFG. Let ijj be a positive non-decreasing continuous function. If 1(f) = oo, 
then for each C > 0, Skeptic can force 


<C ^ Sn>A„f(Al) i.o. 


A„ ^ oo,limsupc„ 

rt 


(17) 


Once we prove this proposition, we can take the mixture over C = 1,2,.... Then the sharpness 
follows, because for each to e 0<oo, there exists C(m) satisfying (fTOl) . We denote 


Or 


2^3 


m 6 O I A^ ^ OO, lim sup c, 


f(Ai) 


<(1-5)C 


On : = < (u 6 Q I lim A: < oo 


o=„ 


m G O I A^ ^ oo, lim sup c, 


f(Al? 


oo 


We divide our proof of Proposition 14.11 into several subsections. For notational simplicity we use the 
initial capital of a = 1 - 2/e = (e - 2)/e in this section. In Sections l4~T] and \4d2 } we only consider y and n 
with n < cTy. As in Lemmafor the validity, this condition will be satisfied for sufficiently small y and 
relevant n. 


4.1 Uniform mixture of constant-proportion betting strategies 

We consider a continuous uniform mixture of constant-proportion strategies with the betting proportion 
uy, Ije <u < 1. This is a Bayesian strategy, a similar one to which has been considered in IfT^ . 

Define 

mm{n,a-y-l) 

]~^ (1-1- uyxi)du, = a = I - ell. 

2/« /=1 


-1 

At round n < cTy this strategy bets M„ = (1 + uyx^du. Then by induction on r < cr^ the 

capital process is indeed written as 


J2/e 

■*1 n-\ 


]~^(l -I- uyxi)du + x„ My ]~^(1 -I- uyx^du 

lie Jlle 
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Applying (|9l), we have 



+ uyxi)du. 



^uyS„-u^y^All2^^ < £7 < ^7^^% 





for n < (Ty. We further bound the integral in the following lemma. 
Lemma 4.2. For n < cry, 


g7^Alc„^2y(S„le-yAlle^) 


J7 < 


oT^^l^n 


o7 K^n 


mm < e' 


mm < e 


SlK2Al) ^£SJ2\ 

jK ’ J 

Sll(2Al) ^yS„-y^All2\ 


jAn 


if Sn< '2.7Alle, 
if 2yAlle <S„<yAl, 

if S„>yAl. 


Proof. Completing the square we have 

1 


-mVa^ + uySn = - Y 


+ 


jAi) 2Ar 


Henee by the ehange of variables 


V = 7A„ M 


S n 

^ir 


du = 


dv 

7An 


we obtain 


!'■ 

J2/e 


^uySn-Fy-Al/2^^ _ ^Sll(2Al) 


^ ^Sll{2Al)_ 


f exp 

J2le 

’-f 

yAn Jn 


( .,.2\2 


y^K 


s „ 


yAl 


2\ 


du 


nf 


>yAn-SnlAn 


"l^dv. 


2yA„le-S„/A„ 


(18) 

(19) 

( 20 ) 


Then for all eases we ean bound f7„ from above as 


£7 < g7^Kc„+Sil{2Ai,) 


yfh: 

yAn ' 


( 21 ) 


Without ehange of variables, we ean also bound the integral g{u)du, g(u) : 


„uySn-Fy^All2 j; 


, direetly 


as 


J g{u)du < max g{u). 

2le 2le<u<\ 


Note that 


g(2/e) = e^ASJe-yAJe ^ ^yS„-y A„/2_ 

We now eonsider the following three eases. 


( 22 ) 
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Case 1 < lyAlle. In this case SnlijAl) < 2/e and by the unimodality of g(u) we have max 2 /<;<„<i g(u) 

g(2le). Henee (flSl) follows from (1221) . 


Case 2 '^7^1/f < Sn < yA^. In this case max 2 /e<„<i ^(m) = g{Snl{yAl)) = and £l < 

A„c„^5„/(2A„) Furthermore in this case Sl < yAlS„ implies 5^/(2A^) < ySnl2 and we also 


have 


£7 < gr^A%^yS„/2^ 


(23) 


By (I 2 TI) and (1231) . we have (fT9l) . 


Case 3 5„ > yA^. Then S^KyAl) > 1 and max 2 /e<„<i g(u) = ^(1). Hence 

£7 < g7^A%^yS„-7^Al/2^ 


By (I 2 TI) and (l24l) . we have (l20l) . 


(24) 


□ 


4.2 Buying a process and selling a process 

Next we consider the following capital process. 

Ql:=2£l-'Kr. (25) 

This capital process consists of buying two units of £l and selling one unit of This combination 
of selling and buying is essential in the game-theoretic proof of LIL in Chapter 5 of lITTlI and [[T4l . 
However, unlike Chapter 5 of [fTTll and lfT4l . where a combination of three capital processes is used, we 
only combine two capital processes. 

We want to bound Ql from above. 


Lemma 4.3. Let 



Cl := 

/(2e-l)((l+eV2l^c„ + ln2)\ 

“7 (.-ir )■ 

(26) 

Then for n < a ye, 

f Cl 

if S„<yAlle, 

(27) 



,75.1 if yAlle<S,<eyAl. 

y^n j 

(28) 


i Cl 

if Sn>eyAl. 

(29) 


Remark 4.4. In this lemma, C\ depends on c„, y and A„ through y^A^c„. However from Section 1431 on. 
we evaluate y^A^Cn from above by a constant. Hence, C\ can be also taken to be a constant (cf. (l50l) ') not 
depending on y and A„. Also note that the interval for in (1281) is larger than the interval in (fT9l) . 

Proof. We bound = 2£j„ - Kff from above in the following three cases: 

(i) Sn < yAhe, (ii) yA^/e < < eyA^, (iii) > eyA^, 

Case (i) In this case S„le - yT^Je^ < 0. Hence (1271) follows from (fTSl) and (3^ < 2Jff- 
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Case (ii) We again use (3^ < llZ- If < Sn < 2yAl/e, then 


Sn jAl ^ yAl ^ Sn 
e ~ ~ e 


and £j„ < from (fT^ . Otherwise (l28l) follows from (fT9l) and (l20l) . 

Case (iii) Sinee 5„ > eA^y > A^y, by (l24l) we have X« < 


'•« — ~^n ' 'n 

^3a2^ .,c _^2a2 


1 


A ;;/2 I ^_ ^~( l + e ^) r ^ Aic „^ y { e - l ) S „-{ e ^- l ) y ^ Af ,/2\ 


1 


Henee if the right-hand side is non-positive we have Ql < 0: 


S„ > eAly and - (1 + e^)y^Alcn -ln2 + y(e- 1)5„ - -(e^ - l)y^Al > 0 

^ Ql<0. 

Otherwise, write 5„ := (1 -l- e^)y^Alc„ -l- In 2 and eonsider the case 

yie-l)S„-^(e^-l)y^Al<Bn. 

Dividing this by e - 1 and also considering S„ > eA^y, we have 

yS„ - l-ie + l)y^Al < 

2 e - 1 


-S„ + eA„y < 0. 


y X (1^ -I- (I3TI) gives 




or ly2^2 < 

2^ "-(e-1)^ 


(30) 


(31) 

(32) 


Then by (I3TI) 


1,2 4 2 


rS - -v^A^ < "" -I- 


Hence just using Ql < 2£l and (l24l) in this case, we obtain 

\2e - 1)((1 -I- e^)y^Alcn + In 2) 


(^n<^e exp^ 

This also covers (l30l) and we have (l3^ for the whole case (iii). 


(e - 1)2 


Cl. 


(33) 


□ 
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4.3 Change of time scale and dividing the rounds into cycles 

For proving the sharpness we eonsider the ehange of time seale from A to k: 

A = 


By taking the derivative of In d = 5klnk, we have = 5{lnk+l)dk. Sinee Inkis dominant in (lnk+1), 
the integrability eondition is written as 


r 


l^— = oo « 


dA 


X oo 


OO. 


Let f{x) := (^'('^^'''"'d/2 Sinee xe is deereasing for v: > 1, the funetion f{x) is deereasing for 

X sueh that > 1. Thus, for suffieiently large k and x sueh that k<x<k+l,we have 


- ln(k + \)f{k + 1) < In kf(x + 1) < In xf(x) < ln(k + l)f{x) < 2 In kf{k). 


Henee, we have 


^oo 

^1 i~i 




k=l 

5/tln/t', -l/r(e5«n*)2/2 


Then, it suffiees to show (fT71) if = oo. 

As in Chapter 5 of IfTTlI and [[T4ll . we divide the time axis into “eyeles”. However, unlike in Chapter 5 
of IfTTl and (HI, our eyeles are based on stopping times. Let 


k=l,2,.... 


and define a family of stopping times 


Tk := mm 


[n\Al 


> nk\ . 


(34) 


(35) 


We define the k-th eyele by [t^:, Tjt+i], k > 1. Note that tu is finite for all k if and only if ^ oo. Betting 
strategy for the k-th eyele is based on the following betting proportion: 


Jk ■ = 


<A('^A:+i),2 


v^L+r 


k\ 


(36) 


Note that jk in (361) is slightly different from (T^ . 

For the rest of this seetion, we eheek the growth of various quantities along the eyeles. Let co e Qc- 
For suffieiently large n, 

A 

^ Cfj ^ C~ 


^(Ab- 

Furthermore = A^_j + xl- This allows us to bound xl and in terms of A^_j. By squaring (371) we 
have 

^n-l 


xl<C^ 


and 




<A(A2)6 - C2 
C2 


2n6 




. .2 <A(^«) 

) - ^n-1 




(38) 


(39) 
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Since - C^) ^ 1 as n ^ oo, we have 


lim^ = l. 

n—^oo 

n-[ 

Note that definition of t^. Henee for oj 6 Q.c we also have 

lim — = 1. 

k-^oo flji 

The limits in the following lemma will be useful for our argument. 

Lemma 4.5. For co e Qc 


k^A^ 

— 1, lim- - = e~\ \\my^Ar,il/(nk+i) = 0. 

k^oo l//{nf^+\) k-^oo rif^+i k-^oo 


lim 


Proof. All of tk^irik), <A^(n^+i), if/^irik), iJ/Hrik+i), iA(%+i), i{/(nk+ilk'^) are of the order 

V21nlne5^‘"Hl + o(l)) = V21n/t(l + o(l)) 
as k ^ 00 and the first equality holds by ([5]). The second equality holds by (l?01) and 


k^tik 

hm-= hm 


= lim 1 


f. 


1 


5(i:+l) 


= e 


k->oo rik+l {k + /:-*oo ^ k + \ ! 

Then A2^/nj-+i = (1 + o{\))nklnk+i = 0{k~^) and the third equality holds by 

ykAr,ik{nk+i) < ik(nk+ifk^((\ + 6)nklnk.^\f'^ ^0 {k ^ co). 


(40) 


(41) 


(42) 


□ 


4.4 Stopping times for aborting and sequential freezing for each cycle 

In (I4S1) of the next section we will introduee another eapital process which will be employed in 

each cycle. Here we introduee some stopping times for aborting the cyele and for sequential freezing of 
accounts in 

We say that we abort the k-th eycle, when we freeze all aeeounts in the k-\h cycle and wait for the 
{k + l)-st cyele. There are two oases for aborting the A:-th cyele. The first ease is when some c„ is too 
large for co eQ.c- Define 

ak,c := min jn > | CnikiA^f > (1 + d)CA„_i). (43) 

We will abort the k-\h eycle if cr^. c < Tk+\. Note that for oj &0.c, there exists kfoS) suoh that 

c^k.c = 00 , for > ki{(jS). (44) 

Another ease is when 5„ is too large. Define 

Vk := min{n > | Anif/{Al) < S„}. (45) 
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If Vk < Tk+\, then Skeptic is happy to abort the k-th cycle, because he wants to force S„ > i.o. 

The above two stopping times will be used in the final construction of a dynamic strategy in Section |431 
For each cycle, we define another family of stopping times indexed by w = 1,..., [Ink], by 

) ^k+l 1 


Tk,^ : = mm I a; > e"'"' -—j . ( 46 ) 

for sequential freezing of accounts of A1”’^ in (ITS]) . We have tj- < for k> 1 and w > 1, because 


> = Hk- 


k^ 


k^ 


Lemma 4.6. Let co e Qc- tk,iink] ^ Tk+i for sufficiently large k. 

Proof. By _j < e^^'^'^^^nk+ilk‘^ and by (l38l) . for sufficiently large k we have 




A2 

,2 


(l+6)C^ 


< 


fiAlf - f{Alf 


X 




and 


Then 


< s A. s(i+tf)<' 


2(w+2) 


k^ 


O-k+l 

1^' 


(47) 


< (1 + = (1 + < A 


0 I 


2 

Tk+1 ‘ 


□ 


We also compare Tk^y^, to cr^^^-w+i defined in ([S]). This is needed for applying the bounds derived in 
previous sections to in the next section. 

Lemma 4.7. Let co 6 Qc- ^ cr^te-“'+i for sufficiently large k. 

Proof. By (|47]) and by Lemma [3Tl for sufficiently large k 


Jke 


-VP+1 - 


"T'k.w 




oW+2 


V^^+1 ^ /i , c^\2r^ 3*A(^fc+l) 


V^fi+T 


k'^fiAlff 


< (1 + 6YCe^ 


fiAif 


< 6 , 


because f{nk+\)lf{A\ Y ^ 0 as k ^ oo by (l42l) . 


□ 


4.5 Further discrete mixture of processes for each cycle with sequential freezing 

We introduce another discrete mixture of capital process for the k-th cycle. Define 


. ^ink^ 

^yk.k - y Qne-"’ 

« • (inkl ^ [-inyt] 

W=1 


. link] 

— 

zLj'' 


- ) 

min(n,Tt,w) mm(n,Tk,„)'' 


(48) 


W=1 


Note that the w-th account in the sum of Al^*^’^is frozen at the stopping time Tk,w- This is needed since the 
bound for c„ is growing even during the k-th cycle. 

In order to bound we first bound Ci in (l26l) for each w in the sum of (l48l) by a constant 

independent of n. Note that we only need to consider n < Tk,w for the w-th account. 
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Lemma 4.8. Let io e Qc- (7k^ and hence C\ are bounded from above by 


{yue-^fAlcn < (1 + 5)^Ce\ 

r . . /(2e - 1)((1 + + ln2) 

L,<ie exp^ 

for sufficiently large k. 

Proof By (|4^ . for sufficiently large k 

f(nk+i) <A(ffi+i) / 1 , c 
-^— <- <1+0. 

Thus 


Cl, 


<!+S^tV=>.x+ x(i+«c '*"■ 


, 3/2 

^k+l 




< (1 + < (1 + 6fCef 


Tk^ 

‘^nJ> 




3/2 

'-k+l 


(49) 

(50) 


(51) 


□ 


Lemma 4.9. Let lo 6 Qc- For sufficiently large k, 


Mf’’^ < Cl + 


rin/tl 


yi+SfCe^ 


max 

y€[n/^.r*] 


min{e' 


.slain) 


vfin 
jK ’ 


njSn 


n G [Tk,Tk+\\, 


(52) 


where C\ is given by the right-hand side of (l50l) . 

Proof We have \yke~'^Cmm{n,Tu,„)\ ^ \yke~'^^^Cmm(n,Tt^„)\ < 5 by Lemma 14771 Then we ean eomplete the proof 
of (l52l) by Lemma 143] and Lemma 14771 beeause the length of the interval 

I -w SfiOi 

w I — < ye <-> 

ne n ) 


is equal to 2. 

As in Chapter 5 of Shafer and Vovk [|T71 . we use in the following form. 


□ 


A7f:= a + — rinkl^-Cn^+Oe' 


-iACnt+l) /2 




2 24 + 4Ci 

or = 1 -, D = - 

e a 


(53) 


Here we give a speeilie value of D for definiteness, but from the proof below it will be clear that any 
suffieiently large D can be used. Since the strategy for is applied only to x„’s in the eyele, a = 

= Mjf. Coneeming we prove the following two propositions. 

Proposition 4.10. Let to e Lie- Suppose that 


-Anf^iAl) <Sn< AnfiAl), Vtt 6 [t^.T^+i]. 


(54) 
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and Tk^\ < crk,c- Then for sufficiently large k 


Vn £[Tk,Tk+i], 


a 


(55) 


and 




1-6 

D 




(56) 


Proof. In our proof we denote t = n - ti„ S t = S „ - S ^ and Af = - A^^ for n > Tt- For proving 

2 

we use (I52l) for 5,. We bound A1”’* from above. By the term -—— on the right-hand side of (l52l) . it 

I In k\ 

suffiees to show 

5, < Ar,f^{Al) + ^Al+Ajf(Al + A?) 

^ Vy 6 [7,^,7,], Vt 6 [ 0 , - r,] 

yAt 4 


for suffieient large k. Let 


9 11 ^ 

Cl =-T s.t.-d > 0 . 

(l+ 2 d )2 2 


(57) 


We distinguish two oases: 


(a)A?<^, ,b):^<Af<AL-A 5 , 


Cl 7 


Cl 7 


For ease (a), Ar^ifj^{A\f) < (1 - 1 - 6)Ar^if/(nk+i) by the first equality in Lemma 1431 for suffieiently large 
k. Also iA(AJ^ -I- Af) < fffik+i). Henoe in this ease 

ySi < ^(1 -I- d)7A^^ -I- ^Jy^Al^ - 1 - fink+xf jc^fink+i). 

Then for 7 < y^ by the third equality in Lemma 1431 

75 , < ^(1 d)7;tA^^ -r ^JylAl^ + fffik+if -h 6 


for suffieiently large k. Sinee 


Ac 


(58) 


we have > ajl uniformly in 7 6 [y^/fc, jk]- 

For ease (b), f{nk+\)l fficl < yAt and 5? < ^(1 -l- 6)Ar,^ + ^A^^ + A^j f(nk+i). Henee 


0 (k ^ 00 ), 


yA, 
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< X----exp 


(1+S)A„+ ^Al+AjJ 


2A? 


2g(l+(5)^e'’C g^p 


^{nk+\) 

(1 + (1 + 6f)Al + 2(1 + ^Al+Af 




2 A? 


<A(«-t+i) 


( 59 ) 


For 7 < 7i, 


A^ A^ 


^A:+l 


Hence if/ink+irA-^JAf Oask ^ oo. Similarly i//(nk+i) ArJAt Oask ^ oo, because i//(nk+i) ArJA, = 
0{k~^l^(\nk)^!^). Therefore the right-hand side of (l59l) is bounded from above by ^fln Ajci{\+6) 

for sufficiently large k and 

jA, 4 

with the choice of D in (15^ and Ci in (157]) . This proves (l55l) . 

Now we prove (15^ . We focus on the w-th account when n > Recall that in this proof we have 
been denoting A^ = A^- A\^. Similarly we denote instead of A^^^ - A\^. Thus 


2 (w+ 2 )^ 2 . x 2 

^4 


We will show that lim sup^^^ < 0, if 

S < Ar,if/{Al^) + Ar,^^,if/{Al^ J < if/{nk+i) |a^, + A^,„,) < 2il/{nk+i)A 

We evaluate ^ 

^rfr '■= f exp (uyke-'^S ,,,, - u^rje-^'^Al J2)du 
Jl/e 


Tk,M 


(60) 


(61) 


l2/e 
,2^,2„-2 wa2 


from above. Because - u^y^e ^'^A\^J2 is maximized at w = S ri,„, I(yk^ 




< 


2if/(nk+i)A 




2 V^it+i 2 2 

< - - - < _ < _. 






the integrand in is maximized at 2/e and we have 


£Zfy^ < exp 

* k,w ^ 


2 2yle-^^A^ ^ 

-ne - 


'^k,v. 


By (l60l) and (IMl) . for sufficiently large k. 


2yle~^"A\.: 47,^(n,+i)A,,^„, 2ylA 


-yke-'^s 

e 


'^k,v.’ 


2- < 


2 /t 2 
■Flc.vi 


o W +1 


£? 2 (w+ 1 ) 
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\e 

ilj{nk+\fk^Ar,^^, 4 

ye 


e'^^n^e^j 

^ L il+6)k^nk 


< -ik(nk+i) 


^Tn^e" 
e^il/{nk+if 


X 


■\/nj^e' 


W+2 


F 


The last inequality holds because lim^^^oo = 0 and A/e - 2 < -1/2. Hence JZll, ^ 0 

uniformly in 1 < w < [In A:]. This implies limsup^_,^ <0. □ 

Proposition 4.11. Let co e Qc- Suppose that Vk < min(T*+i, cr^t^c) and 


-Anl//^{Al) < Sn, Ln 6 {Tk,Vk\. 


Then for sufficiently large k 


p^yk,D > ® 
- 2 


Proof. As in the proof of the previous lemma, we denote t = n - Tk, S t = S „ - S n, and Aj = Al - A^^. 
We distinguish two cases: 

(a) Ai < (b) < A?, < A?, - A? 


n 


Cir 


^k '^k+l ^k‘ 


For case (a), for sufficiently large k and for any y < y^, as in 


ySy^ < r(5^,_i +Cv,) < y 


< i/j{nk+\Y I —= + 6 


(1 + d)A,, + .^Al+Al_,y(n,^,) + (1 + 6)C 


Jai +a^ . 

yj Tk Vk-l 




and 


^0 (k^ oo). 


Hence Nyf^ > a/2 uniformly in y 6 [yk/k,yk\. 
For case (b), Sy,^ can be evaluated as 


Syj^ < S Vj-1 + Cyj^ < S Vj-1 + (1 + 6)C 


+K-1 

HAIY 

< ((1 + S)Ar^ + .^Al +A2^) + (1 + 6)C^ 
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by dSB- Put 




■ tj — 


Sk := 


(1 +5)C 


A2^ <A(«-t+i)^’ ’ (A(^?,)V(«-t+i)’ 

so that lim^. qi,i//{ni,+i)^ = 0 and lim^. = 0. Then for sufficiently large k 


n 




< |(1 + + (1 + ^)(1 + Sk)qk + qI + (1 + ^k)^ I2 <A(^/t+i)^ 


iA(%+i)^ , ^ 
< -r-1- o. 


Then 




yA 


n 


□ 


4.6 Dynamic strategy forcing the sharpness 

Finally, we prove Proposition 14.1[ We assume that by the validity result, Skeptic already employs a 
strategy forcing 5„ > -A„i//^{Al) a.a. for oj 6 Qc- In addition to this strategy, based on Proposition HTOI 
consider the following strategy. 

Start with initial capital TCq = a. 

Setk= 1. 

Do the followings repeatedly: 

1. Apply the strategy in Proposition 14. 101 for n e [Tk,Tk+i]. 

If Tk+\ < min(a-^ c 2 ^k), then go to 2. Otherwise go to 3. 

2. Let k = k + 1. Go to 1. 

3. Wait until 3k' such that - {r^) < Srj,, < Set k = k' and go to 1. 

By this strategy Skeptic keeps his capital non-negative for every path oj. For oj 6 Qq, Tk = 00 for 
some k and Skeptic stays in Step 1 forever. For co e Q=oc, Step 3 is performed infinite number of times, 
but the overshoot of \x„\ in Step 3 does not make Skeptic bankrupt by Proposition 14.111 Now consider 
oj G Q-c- Since Skeptic already employs a strategy forcing > -A„if/^{Al) a.a., the lower bound in (l54l) 
violated only finite number of times. By m G Qc. ^ ^ CTk.c is happens only finite number of times. Hence 
if Sm < Ani^{Al) a.a., then Step 3 is performed only finite number of times and there exists ko such that 
only Step 2 is repeated for all k > ko. Now for each iteration of Step 2, Skeptic multiplies his capital at 
least by 

Then 

k=ko k=ko '' 

Since the left-hand side diverges to infinity, the above strategy forces the sharpness. 
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